Image Processing Apparatus, Method and Program 
Enabling High-Precision Color Conversion 



[000 1] This application is based on application No. 2000-29 1583 filed in 
5 Japan, the content of which is hereby incorporated by reference. 
BACKGROUND OF THE INVENTION 
Field of the Invention 

[0002] The present invention relates to image processing apparatuses, 
image processing methods and programs to cause computers to perform 

10 image processing. More particularly, the present invention relates to an 
image processing apparatus, an image processing method and a program to 
cause a computer to perform image processing that allow high-precision 
color conversion of an image. 
Description of the Related Art 

15 [0003] Conventionally, a technique for reading an image from an 

original with a reading device like a scanner, performing color conversion 
with a computer connected to a network, and outputting the image to a 
printer or the like is known. 

[0004] For example, Japanese Patent Laying-Open No. 11-177754 
20 discloses a scanner system in which the system having a plurality of 

scanners connected to a network determines which scanner to use, in terms 
of hardware, according to an input condition of the original. 
[0005] For color conversion of an image, a color information file (or a 
color conversion file, e.g., an ICC (International Color Consortium) profile) 
25 specific to a device is referred to, which is created based on representative 
colors. The file defines color information specific to the device, and is used 
for exchanging the color information with another device. 
[0006] The color conversion file generally stores data of representative 
colors picked up considerably roughly from a color space that the relevant 
30 device is able to reproduce, and data of the corresponding colors in another 
color space, by correlating the data with each other. Color conversion of the 
colors having not been picked up are carried out by interpolation. This type 
of color conversion employing interpolation from roughly picked up colors, 
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however, is disadvantageous because the precision in color conversion is 
degraded. 

[0007] For example, if colors R, G and B are represented with 8 bits each, 
each color can be expressed with 256-step gradation. In the combination of 
5 RGB, approximately 16,770,000 colors can be expressed. 

[0008] To handle these colors, measuring all the 16,770,000 colors and 
preparing color conversion files (look-up tables) by correlating them with, 
e.g., L*a*b* data would be unrealistic, since it requires an enormous file 
capacity. In practice, it is common to pick up each color of RGB every 10 

10 steps of gradation or so to obtain data of less than 1,000 colors, and to 

prepare color conversion files correlating the obtained data with L*a*b* data. 
In this case, data of the colors having not been picked up are obtained by 
interpolation, which often results in insufficient precision for fine color 
reproduction. 

15 SUMMARY OF THE INVENTION 

[0009] The present invention is made to solve the problems described 
above, and its object is to provide an image processing apparatus, an image 
processing method and a program to cause a computer to execute image 
processing that allow high-precision color conversion. 

20 [00 10] To achieve the object, according to an aspect of the present 

invention, the image processing apparatus includes: a storage device to store 
at least two color information files having contents different from each other; 
a selecting unit to select one of the at least two color information files 
according to brightness of image data; and a sending unit to externally send 

25 the selected color information file by attaching the relevant file to the image 
data. 

[00 1 1] According to another aspect of the present invention, the image 
processing program causes a computer to execute processing including: the 
step of selecting one of at least two color information files having contents 
30 different from each other according to brightness of image data; and the step 
of externally sending the selected color information file by attaching the 
relevant file to the image data. 

[0012] According to yet another aspect of the present invention, the 
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image processing method includes: the step of selecting one of at least two 
color information files having contents different from each other according to 
brightness of image data; and the step of externally sending the selected 
color information file by attaching the relevant file to the image data. 
5 [00 13] The foregoing and other objects, features, aspects and 

advantages of the present invention will become more apparent from the 
following detailed description of the present invention when taken in 
conjunction with the accompanying drawings. 
BRIEF DESCRIPTION OF THE DRAWINGS 
10 [0014] Fig. 1 shows a configuration of the image scan system according 
to an embodiment of the present invention. 

[0015] Fig. 2 shows a configuration of the scanner 100 in Fig. 1. 

[00 16] Fig. 3 shows a configuration of the personal computer 200 in Fig. 

1. 

15 [0017] Fig. 4 illustrates the contents of the color conversion process 
conducted by personal computer 200. 

[00 18] Fig. 5 shows examples of the color conversion file. 
[00 19] Fig. 6 illustrates the process of interpolation. 
[0020] Fig. 7 illustrates an example of the L*a*b* color space. 
20 [002 1] Fig. 8 is a flow chart illustrating the process of creating and 
registering a color conversion file. 

[0022] Fig. 9 shows data of a chart for use in creating a standard color 
information file. 

[0023] Fig. 10 shows data of a chart for use in creating a color 
25 information file for shadow. 

[0024] Fig. 1 1 shows data of a chart for use in creating a color 
information file for highlight. 

[0025] Fig. 12 is a flow chart illustrating the color conversion process. 
DESCRIPTION OF THE PREFERRED EMBODIMENTS 
30 [0026] Referring to Fig. 1, the image scan system is formed of a scanner 
100, a personal computer (PC) 200 and a printer 300, which are connected to 
each other through a network 400. 

[002 7] Fig. 2 shows a detailed configuration of scanner 100 shown in Fig. 
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1. Referring to Fig. 2, scanner 100 includes a network interface 120 for 
connection with network 400, a scanner unit 102 formed of a charge coupled 
device (CCD) or the like for reading an image from an original, a send 
address designating unit 104 for designating an address to which image 
data obtained by scanning is to be sent, and a processing unit 106 for 
analyzing the image data obtained by the scanning, creating color 
information files (also referred to as color conversion files) from the data 
obtained by the scanning, and selecting and sending an optimum color 
information file. 

[0028] Processing unit 106 includes a color information file creating unit 
108 for creating a color information file from the read data, a color 
information file storage unit 110 for storing at least two such color 
information files created, a send address storage unit 112 for storing an 
address to which the color information file is to be sent together with the 
image data, a color information file selecting unit 114 for selecting an 
optimum color information file based on a result of analysis of the image 
data obtained by scanning, a scanned data analyzing unit 116 for analyzing 
the image data obtained by the scanning, and a file sending unit 118 for 
sending the color information file with the image data. Color information 
file storage unit 110 and send address storage unit 112 are each formed of a 
storage device such as a hard disk. 

[0029] Scanner 100 having such a configuration is usually called a 
network scanner. That is, a single scanner 100 is shared by users on 
network 400. For example, a user inputs an address of his/her own 
personal computer from a liquid crystal monitor of scanner 100, and presses 
a scan button provided at the body of scanner 100. The image data 
obtained by scanning is then captured to the user's personal computer via 
network 400 (the process shown with an arrow (1) in Fig. 1). 
[0030] At this time, a color information file of the scanner 100 is 
attached to the image data and sent to the personal computer. This color 
information file serves as reference data for reproduction of the identical 
colors with another device. 

[0031] The present embodiment is advantageous in that, when image 



data obtained by scanner 100 is being sent together with the color 
information file specific to the device, an optimum color information file is 
automatically selected from a plurality of color information files prepared, 
according to the relevant image data. 
5 [0032] It is noted that color information file storage unit 110 shown in 
Fig. 2 may store in advance a plurality of customized color information files, 
besides the color information files created by color information file creating 
unit 108. 

[0033] Fig. 3 shows a configuration of personal computer 200 in Fig. 1. 

10 [0034] Referring to Fig. 3, personal computer 200 includes a central 

processing unit (CPU) 601 for performing an overall control of the device, a 
display 605 for displaying an image or text data, a local area network (LAN) 
or modem card 607 for connection with network 400 or the like, an input 
device 609 formed of keyboard, mouse or the like, a flexible disk drive 611, a 

15 compact disc-read only memory (CD-ROM) drive 613, a hard disk drive 615, 
a random access memory (RAM) 617, and a ROM 619. 

[0035] Flexible disk drive 611 can read data or a program recorded on a 
flexible disk F. CD-ROM drive 613 can read data or a program recorded on 
a CD-ROM 6 13a. A program for execution of the process that will be 
20 described below with reference to a flow chart can be provided by flexible 
disk F or CD-ROM 6 13a. Alternatively, the program may be recorded on 
hard disk (driven by hard disk drive 615), RAM 617, ROM 619 or other 
storage mediums including a memory card. 

[0036] Fig. 4 illustrates the color conversion process being conducted in 
25 personal computer 200. First, personal computer 200 processes received 
image data (scanned data) using a scanner color information file also 
received, to create intermediate data. Herein, assume that the image data 
is RGB data and the intermediate data is L*a*b* data. 

[0037] Next, personal computer 200 converts the intermediate data into 
30 image data for printer (printer data) using a printer color information file 

representing the characteristics of printer 300. In this example, the printer 
data is assumed to be CMYK data. 

[0038] One of the representative color information files is an ICC profile. 
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The color information files including the ICC profile are standardized by The 
International Color Consortium. Using the color information files, it is 
possible to describe the color characteristics of display, scanner, digital 
camera, printer and others. 
5 [0039] Fig. 5 shows examples of such a color information file. The table 
on the left side of Fig. 5 is a scanner color information file (RGB -> L*a*b*), 
and the table on the right side is a printer color information file (L*a*b* -> 
YMCK). 

[00401 As shown in Fig. 5, each color information file does not store data 
10 corresponding to all the colors; it only stores data corresponding to 
representative colors. 

[00411 Thus, as explained above, interpolation is carried out for 
conversion of the colors not recorded on the color conversion file. 
Hereinafter, the interpolation effected for converting RGB data to L*a*b* 

15 data will be described. 

[0042] Referring to Fig. 6, it is assumed that image data (Rp, Gp, Bp) of a 
point p within the RGB color space, which is not recorded on a color 
conversion file, is to be converted to L*a*b* data. In this case, of the colors 
registered on the color information file in advance, those at the points in the 

20 vicinity of the point p as a target of conversion are referred to, and L*a*b* 
values (intermediate data) corresponding thereto are found. (In the 
example of Fig. 6, the L*a*b* values are found for the colors at points pl-p8 
surrounding point p.) 

[0043] Here, assume that, when the RGB data at point p is (Rp, Gp, Bp), 
25 the image data at points p l-p8 are as follows: 

pi = (Ri, Gi, Bi) 

p2 = (Ri + i, Gi, Bi) 

p3 = (Ri + i, Gi+i, Bi) 

p4 = (Ri, Gi+i, Bi) 
30 p5 = (Ri, Gi, Bi + i) 

p6 = (Ri + i, Gi, Bi + i) 

p7 = (Ri + i, Gi+i, Bi + i) 

p8 = (Ri, Gi+i, Bi + i) 
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where Ri < R P < Ri+i, Gi < Gp < Gi+i, and Bi < Bp < Bi+i. 

Then, the L*a*b* value at point p can be calculated as follows: 

s 

Lp* = ]>^wi Li * 

1=1 

8 

ap* = ^ wi ai * 

1=1 

8 

bp* = wi bi * 

i=i 

5 wherein Li*, ai* and bi* (i = 1-8) are the L*, a* and b* values corresponding 
to the (R, G, B) data at the lattice points pl-p8, and wi represent weighting 
factors of respective points pl-p8, which are calculated as follows: 

wl = (l-r)(l-g)(l-b) 
10 w2 = r (1 - g) (1 - b) 

w3 = r g (1 - b) 

w4 = (l-r)g(l-b) 

w5 = (l-r)(l-g)b 

w6 = r (1 - g) b 
15 w7 = rgb 

w8 = (1 - r) g b 

where 

r = (Rp-Ri)/(Ri + i-RO 
g = (Gp-Gi)/(Gi + i-Gi) 
20 b = (Bp-Bi)/(Bi + i-Bi) 

[0044] When the L*a*b* values of point p are obtained, CMYK data for 
outputting the equivalent values is calculated back from, e.g., a printer color 
information file (see Figs. 4 and 5). Such data conversion is generally 
25 conducted on a personal computer. 

[0045] The method for creating the color information file by color 
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information file creating unit 108 will now be described in brief. 
[0046] For creation of the color information file, in the case of a scanner, 
for example, a color chart (a sheet on which a plurality of colors (color 
patches) are depicted) is first read by the scanner. The color patches are 
5 separately measured by a colorimeter. A look-up table (LUT) is then 

created wherein the L*a*b* values of the colorimetrically obtained data are 
correlated with digital 3-signal values R, G, B (of, e.g., 8 bits each) being 
response characteristics (output signals) of the relevant scanner (see Fig. 5). 
This look-up table constitutes the color information file. 
10 [0047] Here, the L*a*b* is a standard for expressing color with three- 
dimensional orthogonal coordinates, set by The International Commission 
on Illumination (CIE). 

[0048] Fig. 7 schematically shows the L*a*b* color space. In Fig. 7, the 
portion surrounded by W, BK, Y, M, C, R, G and B corresponds to a color 

15 reproduction range being expressed on a paper. W, BK, Y, R, M, B, C and G 
represent the color saturated portions of white, black, yellow, red, magenta, 
blue, cyan and green, respectively. In Fig. 7, an image becomes brighter as 
the numerical value of the L* axis increases (L* is larger), whereas the 
image becomes darker as the numerical value of the L* axis decreases (L* is 

20 smaller). Almost all the color management systems at present employ the 
L*a*b* color space as the base. 

[0049] Fig. 8 is a flow chart illustrating the color information file 
creating process to be done by color information file creating unit 108 in 
scanner 100 according to the present embodiment. The relevant process is 

25 executed by color information file creating unit 108 according to the program 
stored in a storage device such as ROM, hard disk or the like, not shown. 
[0050] Referring to Fig. 8, in step S101, a user creates a color chart (a 
sheet having color patches depicted thereon) by outputting image data to a 
silver salt photo printer, for example. Here, a chart commercially available 

30 may be used as a standard chart. 

[005 1] When the chart is being output by the silver salt photo printer, 

data for use in creating the chart, as shown in Fig. 9, is employed. 

[0052] Referring to Fig. 9, in this example, 64 color patches No. 1-64 are 
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to be printed to form the chart. In Fig. 9, RGB colors are expressed with 8 
bits each (0-255). R, G and B each take one of four values of 0, 85, 170 and 
255, and the chart data are created by combination thereof. 
[0053] Specifically, since R, G and B each take four kinds of values, 4x4 
5 x 4 = 64 color patches are created. The RGB values (0-255) represent 
brighter colors as they approach from 0 to 255. 

[0054] In the chart data shown in Fig. 9, the RGB values are each set to 
0, 85, 170 or 255. Therefore, colors at the points that separate the RGB 
color space approximately evenly are recorded on the color information file 
10 as data. Thus, the color conversion file created based on the chart data of 
Fig. 9 is called a "standard color information file". 

[0055] Fig. 10 shows chart data for use in creating a color information 

file for shadow, or a "shadow color information file". 

[0056] In this example, the chart data are created by combination of 

15 RGB each taking four values of 0, 42, 85 and 255. That is, the number of 
patches corresponding to the dark portion is increased compared to the chart 
obtained from the chart data in Fig. 9. Accordingly, a color information file 
having data of the dark portion finely segmented and data of the bright 
portion roughly segmented within the RGB color space can be created. 

20 [0057] Since the number of patches in Fig. 10 is again 64 (No. 1-64), it is 
possible to create the shadow color information file with the same capacity 
as the standard color information file. 

[0058] The shadow color information file is suitable for use in 
conversion of a dark image, since it enables high-precision conversion of 
25 dark colors. 

[0059] Fig. 11 shows chart data for creating a color information file for 
highlight, or a "highlight color information file". 

[0060] In this example, the chart is to be created from the combination 
of RGB each taking four values of 0, 170, 2 12 and 255. That is, the number 
30 of patches corresponding to the bright portion is increased compared to the 
chart obtained from the data in Fig. 9. Accordingly, a color information file 
can be created which includes data of the bright portion finely segmented 
and the dark portion roughly segmented within the RGB color space. 
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[006 1] Again in Fig. 11, 64 patches No. 1-64 are prepared. Thus, the 
highlight color information file can be created with the same capacity as the 
standard color information file. The highlight color information file is 
suitable for conversion of a bright image, since it allows high-precision 
5 conversion of bright colors. 

[00621 Returning to Fig. 8, in step S103, a colorimeter is used to 
measure the colors of patches in the respective color charts, to obtain the 
L*a*b* values thereof. Each color chart is set to a scanner in step S 105 and 
scanned in step S107, whereby the RGB data of the respective patches are 

10 taken in. In step S 109, the RGB data and the L*a*b* data of the respective 
patches are correlated with each other, so that a scanner color information 
file (the table on the left in Fig. 5) is created. The three kinds of color 
information files thus created based on the chart data shown in Figs. 9-11 
are stored in color information file storage unit 110 (hard disk or the like) in 

15 step Sill. 

[0063] Fig. 12 is a flow chart of the color conversion process. 
Illustrated representatively in this flow chart is the case where the data 
taken by a user via network scanner 100 is being output from printer 300 
(corresponding to the case of copying using the network). The relevant 

20 process is executed by portions of processing unit 106 (in practice, a 

processor of a microcomputer or the like) according to a program stored in a 
storage device like ROM or hard disk (not shown). 

[0064] Referring to Fig. 12, a user places an original on scanner 100, for 
example, and inputs or selects the address of his/her own personal computer 
25 200 through a liquid crystal panel (S201). Thereafter, the user presses a 
scan button provided at scanner 100, so that the original is scanned (S203). 
As the address of the personal computer being input by a user, an IP address 
of TCP/IP protocol or others may be employed. 

[0065] The image data read by scanning is subjected to color separation 
30 at scanner 100, and converted to RGB data of, e.g., 8 bits each. In scanner 
100, the RGB color data is converted to monochrome data of 8 bits for image 
analysis (S205). Various kinds of methods are known for such conversion 
to monochrome data, and thus, description thereof is not provided here. 
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[0066] Next, pixels of the monochrome image data are separated to two 
portions of shadow and highlight to create a histogram (S207). The 
numbers of pixels belonging to the shadow and highlight portions are then 
calculated, respectively (S209). 
5 [0067] Herein, the pixels having image data in a range of 0-127 

correspond to the shadow portion, and the total number of pixels therein is 
represented as Ns. Those having image data in a range of 128-255 
correspond to the highlight portion, and the total number of pixels therein is 
represented as Nh. 

10 [0068] If the total pixel number in the highlight portion (Nh) is at least 
twice the total pixel number in the shadow portion (Ns), or if the condition 
Nh > 2 * Ns is satisfied (Yes in S211), then the highlight color information 
file is selected from the color information files stored in color information file 
storage unit 1 10 (S2 15). On the contrary, if the total pixel number in the 

15 shadow portion (Ns) is at least twice the total pixel number in the highlight 
portion (Nh), or if Ns > 2 * Nh (Yes in S213), then the shadow color 
information file is selected from color information file storage unit 110 
(S2 19). If neither one is satisfied, the standard color information file 
having the colors evenly spaced is selected (S217). 

20 [0069] The selected color information file is attached to the scanned 
image data (S221), and sent via network 400 to an address designated in 
step S201 (S223, corresponding to the process shown with the arrow (1) in 
Fig. 1). 

[0070] A user then selects a profile for an output device (printer or the 
25 like) that he/she wishes to use at personal computer 200, for example, and 
converts the RGB image data via the intermediate data to CMYK image 
data for the output device (Fig. 4). The converted CMYK image data is sent 
via the network or the like to the relevant output device (corresponding to 
the process shown with an arrow (2) in Fig. 1). Accordingly, the scanned 
30 image data is duplicated. 

[0071] As explained above, according to the present embodiment, at the 
time when sending an image read by a scanner, a color conversion file 
optimal for the image is selected according to the characteristics of the image. 
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Thus, the color conversion of the image can be done with higher precision 
than in the conventional case. 

[0072] In the embodiment described above, three kinds of color 
information files for standard, shadow and highlight have been created. 
5 However, the number of the color conversion files is not limited to three. 

The present invention is applicable to any case where at least two kinds of 
files are being prepared. 

[0073] Further, in the description above, the processes have been 
effected using software. Alternatively, hardware circuits may be used to 

10 effect the processes. 

[0074] Still further, in the description above, the color conversion file 
has been created by scanner 100. Alternatively, the color conversion file 
may be prestored in scanner 100, or it may be taken in via network 400 and 
stored in scanner 100. 

15 [0075] The present invention is also applicable to the case where color 
conversion is effected by a device unconnected to a network environment. 
[0076] Although the present invention has been described and 
illustrated in detail, it is clearly understood that the same is by way of 
illustration and example only and is not to be taken by way of limitation, the 

20 spirit and scope of the present invention being limited only by the terms of 
the appended claims. 
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